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Abstract Fluctuation theorems, which have been developed over the past 15 years, have re- 
sulted in fundamental breakthroughs in our understanding of how irreversibility emerges from 
reversible dynamics, and have provided new statistical mechanical relationships for free energy 
changes. They describe the statistical fluctuations in time-averaged properties of many-particle 
systems such as fluids driven to nonequilibrium states, and provide some of the very few ana- 
lytical expressions that describe nonequilibrium states. Quantitative predictions on fluctuations 
in small systems that are monitored over short periods can also be made, and therefore the 
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fluctuation theorems allow thermodynamic concepts to be extended to apply to finite systems. 
For this reason, fluctuation theorems are anticipated to play an important role in the design 
of nanotechnological devices and in understanding biological processes. These theorems, their 
physical signiflcance and results for experimental and model systems are discussed. 
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1 Introduction 

Thermodynamics is the study of the flow of heat and the transformation of work 
into heat. Our understanding of thermodynamics is largely conflned to equi- 
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librium states. Linear irreversible thermodynamics is an extension of the 19th 

century concepts of equihbrium thermodynamics to systems that are sufficiently 
close to equilibrium that intensive thermodynamic variables can be approximated 
by the same functions of local state variables, as would be the case if the entire 
system was in complete thermodynamic equilibrium ([l}|2|. Moreover these tra- 
ditional concepts are limited in application to large systems or averages over an 
ensemble of states, referred to as the "thermodynamic limit". 

Inventors and engineers endeavour to scale down machines and devices to 
nanometer sizes for a wide range of technological purposes. However, there is 
a fundamental limit to miniaturisation since small engines are not simply re- 
scaled versions of their larger counterparts. If the work performed during the 
duty cycle of any machine is comparable to thermal energy per degree of free- 
dom, then one can expect that the machine will operate in "reverse" over short 
time scales. That is, heat energy from the surroundings will be converted into 
useful work allowing the engine to run backwards. For larger engines, we would 
describe this as a violation of the Second Law of thermodynamics, as entropy is 
consumed rather than generated. Until recently, this received little attention in 
the nanotechnology literature, as there was no theory capable of describing the 
probability of entropy consumption in such small engines. 

In the last fifteen years, several fluctuation theorems have been proposed that 
revolutionise our understanding and use of thermodynamics. Firstly these new 
theorems lift the requirement of the thermodynamic limit. This allows thermody- 
namic concepts to be applied to finite, even small systems. Secondly, these new 
theorems can be applied to systems that are arbitrarily far from equilibrium. 
Thirdly for the first time, these theorems explain how macroscopic irreversibility 
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appears naturally in systems that obey time reversible microscopic dynamics. 

Resolution of the Loschmidt (Irreversibility) Paradox had defied our best efforts 
for more than 100 years. 

One of these fluctuation theorems, the Evans-Sear les Fluctuation Theorem 
(Evans-Sear les FT) (|3][4||5]), results in a generalisation of the Second Law of 
Thermodynamics so that it applies to small systems, including those that evolve 
far from equilibrium. Another, the Crooks Fluctuation Theorem (Crooks FT) 
(|6][7| provides a method of predicting equilibrium free energy difference from ex- 
perimental information taken from nonequilibrium paths that connect two equi- 
librium states. This FT can be used to derive the well known Jarzynski Equality 
(|8]|9)[lO][Tll[l2|[l3f, which expresses the free energy difference between two equilib- 
rium states in terms of an average over irreversible paths. Both FTs are at odds 
with a traditional understanding of 19th century thermodynamics. Nevertheless, 
these theorems will be essential for the application of thermodynamic concepts to 
nanotechnology systems which are currently of such interest to biologists, physical 
scientists and engineers. 

1.1 The Evans-Searles Fluctuation Theorem 

In many areas of physical chemistry, researchers strive to understand new systems 
through deterministic equations of motion. They seek to quantify microscopic 
forces and understand how a system responds to external perturbations, using 
techniques such as Molecular Dynamics simulation. At the heart of this endeav- 
our is the notion that if the equations of motion or trajectories of the system 
are known, then any question about that system may be answered. However, 
such deterministic equations (such as Newton's equations) are time-reversible. 
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so that for every trajectory there exists a conjugate, time-reversed trajectory or 

"anti-trajectory" which is also a solution to the equations. The relative prob- 
abilities of observing bundles of conjugate trajectories can be used to quantify 
the "macroscopic reversibility" of the system: if the probability of observing all 
trajectories and their respective anti-trajectories are equal, the system is said to 
be reversible; on the other hand, if the probability of observing anti-trajectories 
is vanishingly small, we say that the system is irreversible. The Second Law 
of Thermodynamics stipulates that a system evolves irreversibly in one "time- 
forward" direction, i.e., the probability of all anti-trajectories is zero. However, 
the Second Law strictly applies to large systems or over long time scales and 
does not describe the reversibility of small systems that are of current scientific 
interest, such as protein motors and nano- machines. This long-standing question 
of how irreversible macroscopic equations, as summarised by the Second Law of 
Thermodynamics, can be derived from reversible microscopic equations of mo- 



tion was first noted by Loschmidt(14 15 1 in 1876 and has been a paradox since 
then. Boltzmann and his successors have simply side-stepped this issue with 
Boltzmann stating "as soon as one looks at bodies of such small dimension that 
they contain only very few molecules, the validity of this theorem [the Second 



Law of Thermodynamics] must cease" (16) 

The Fluctuation Theorem (FT) of Evans & Searles (3]|4]|5| describes how a finite 
sized system's irreversibility develops in time from a completely time-reversible 
system at short observation times, to an irreversible one at long times. It also 
shows how irreversibility emerges as the system size increases. That is, it bridges 
the microscopic and macroscopic descriptions, relating a system's time-reversible 
equations of motion to the Second Law, and provides a quantitative resolution 
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to the long-standing irreversibility paradox. Specifically, the FT relates the rela- 
tive probabilities, p, of observing trajectories of duration t characterised by the 
dissipation function, ilj, taking on arbitrary values A and —A, respectively: 



It is an expression that describes the asymmetry in the distribution of 0,t over a 
particular ensemble of trajectories. The dissipation function, 0,t, is, in general, a 
dimensionless dissipated energy, accumulated along the system's trajectory; ex- 
pressions for Of differ from system to system. However, any trajectory of the sys- 
tem that is characterised by a particular value 0,t = A has, under time-reversible 
mechanics, a conjugate or time-reversed anti-trajectory' with 0,t = —A. In this 
way, the LHS of the FT has also been interpreted as a ratio of the probabili- 
ties of observing trajectories to their respective anti-trajectories. The dissipation 
function, 0,t, is an extensive property, i.e., its magnitude scales with system size, 
and it also scales with the observation time, t. Thus, eqn [T] also shows that as 
the system size gets larger or the observation time gets longer, anti-trajectories 
become rare and it becomes overwhelmingly likely that the system appears time- 
irreversible, in accord with the Second Law. That is, the evolution of a large 
macroscopic system proceeds preferentially in one direction. In addition, eqn [l] 
also shows that the ensemble average of the dissipation function is positive for 
all t for all nonequilibrium systems and for any system size; i.e., {^It) > 0, (5). 
We will refer to this as the Second Law Inequality. 



p{^t = A) 

p{nt = -A) 



exp {A) . 




1.2 The Crooks Fluctuation Theorem and the Jarzynski Equahty 

From classical thermodynamics, the work done by an external field to drive a 
system from one equilibrium state to another equilibrium state is equivalent to 
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the change of free energy, AF, between the states, only in the special case where 

the path is traversed quasi-statically. That is the path between the two states 
must be traversed so slowly that intermediate, as well as the initial and final 
states of the system, are all in thermodynamic equilibrium. 

Crooks' Fluctuation Theorem (Crooks FT) ([6|[7]) states something quite re- 
markable. In the case of paths that are traversed at arbitrary rate, ranging from 
quasi-static to "far-from-equilibrium" , the distribution of trajectories, charac- 
terised by the work done by the external field over the duration of the trajectory, 
follows 

||ffi^=exp[/5M-AF)|. (2) 

where /3 = l/{kBT), ks is Boltzmann's constant and T is the initial temperature 
of the system on which the external field does work, or equivalently the temper- 
ature of the surroundings with which the system is initially at equilibrium. This 
expression is similar to Evans-Searles FT in that it relates distributions of trajec- 
tories, characterised by an energy, specifically the work, W. While eqn[T]describes 
the asymmetry in the distribution of trajectories starting from the same initial 
distribution. Crooks FT, eqn [2| relates trajectories initiated from two different 
equilibrium states, A and B. That is, it considers (i) a distribution, pj, forward 
trajectories, A ^ B, where the free energy change between equilibrium states A 
and B is AF = Fb — Fa, and (ii) the distribution, p^-, of reverse trajectories, 
B ^ A, where the respective equilibrium free energy change is —AF. Like the 
FT, Crooks FT also quantifies how irreversibility evolves out of reversible equa- 
tions of motion. A perfectly reversible (quasi-static) system is one where the work 
required to traverse B ^ A is equal but opposite in sign to the work required in 
the time-reversed trajectory, A ^ B. Thus the RHS of eqn. [2] is unity for these 
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reversible paths and W = AF, in agreement with classical thermodynamics. 

Taking the ensemble average of —f3W and using the Crooks FT gives, 

exp (-/5AF) = (exp {-I3W)) /. (3) 

Here the notation (...)/ implies an ensemble average using the distribution func- 
tion of state A, and the work is measure over forward trajectories A ^ B. This 
expression was first posed by Jarzynski in 1997 (|8][9]) before eqn [2] was discov- 
ered, and is known as the Jarzynski Equality. It states that the free energy can be 
determined by measuring the work, W , done by an external field along dynam- 
ical paths that connect the two states. These forward paths may be traversed 
at arbitrary rates, so that the intervening states may not be in thermodynamic 
equilibrium. This provides a completely new way of treating thermodynamics. If 
instead of averaging the work, you average the exponential of the work, then you 
can calculate the equilibrium free energy difference from information obtained 
along nonequilibrium paths. On the practical side, Eqn[3j suggests that measur- 
ing work on small microscopic processes could yield thermodynamic quantities 
AF that are traditionally inferred by calorimetric measurements. The importance 
here is that in order to understand molecular-scale processes, it is necessary to 
probe them using molecular time/length scales. 

1.3 Organisation of the Review 

In the following section we will introduce some background concepts required 
for understanding the derivation and consequences of the FTs. We introduce 
general equations of motion for nonequilibrium systems and give expressions for 
the work and heat transferred from the systems. We discuss how thermostatting is 
achieved in simulations, and in particular discuss the thermostatting mechanisms 
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that produce a canonical equilibrium distribution, since it is the canonical state 

that was originally treated in the Crooks FT. In Section 3 we review the concepts 

of the original FT derivation made by Evans and Searles for systems governed 

by deterministic mechanics. Today, many proofs exist for the FTs, extending 



to systems described by quantum, e.g. (17 18 1 and stochastic dynamics e.g 



(19,20). Here we limit our review to the original deterministic treatment and to 
concepts central to the understanding the FT in the context of modern statistical 
mechanics and its applications. We extend this description to provide a derivation 
of the Crooks FT for deterministic systems so as to demonstrate the similar 
basis it has with the Evans-Sear les FT, and we refer collectively to these as the 
FTs. These derivations consider the response of equilibrium systems to external 
perturbations. However, we also show how steady state fluctuation relations can 
be derived for systems that approach a unique steady state, and in those cases, 
how the FTs can be used to obtain Einstein and Green-Kubo relations. In Section 
4 we review applications of the FTs to experimental and model systems. 

2 Background concepts 

The degrees of freedom for a system of particles can be the represented by the 
vectors of time-dependent generalized coordinates, q, and momenta, p. In addi- 
tion, a single point in the system's phase-space is denoted as F = (q, p). Consider 
a closed system that is in thermal equilibrium with a reservoir. From equilibrium 
statistical mechanics, we know that the equilibrium probability distribution of 
the system is given by the canonical distribution function, 

/e.(r) = , (4) 
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where Z = J e~^'^ dT is the equihbrium partition function, and 7i is the internal 

energjj^ which is the sum of the kinetic and potential energies, K(p) and i;^(q), 

of the system. 

A closed adiabatic system can exchange energy with its environment in the form 
of work. We can think of work as the form of energy exchange that is directly 
controllable by the environment. For example, it might be desirable to change 
the mean internal energy, U = (TC), of the system, and this can be achieved by 
externally controlling some parameter A in the potential energy function of the 
system, cj). Examples of such A-parameters include the switch on an externally 
applied electric field in a crystalline salt, the trapping constant in an optical 
trap holding a colloidal particle, or a mathematical agent that changes the size 
of Lennard-Jones spheres in a computer simulation. We emphasise this mode of 
external control by formally making A time-dependent and by writing the internal 
energy as 

n{T,s) = K{p) + 4>{q,X{s)). (5) 

When an external agent does work on a system without changing its underlying 

equilibrium state, which has mean internal energy U, we refer to that field as a 

purely dissipative field, denoting it generally by Fg. This dissipative field does 

not figure in the underlying equilibrium distribution or partition function, but 

drives the system away from equilibrium. While it may be possible to represent 

the external agent using either Fg or A, we choose the convention that if A = 

and Fe = 0, the system will always relax to an (nondissipative) equilibrium state, 
'^More exactly, Ti. is the phase- variable corresponding to the internal energy. For simplicity, 

we will use the term "internal energy" to refer to Ti, and will refer to the thermodynamic internal 

energy U = (TC) as the "mean internal energy" . 
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and that if Fg 7^ 0, the system wih never relax to a nondissipative state. This 

distinction may depend on the state of system {e.g., fluid or solid). Examples 

of such dissipative fields include a fluid under a shear flow, dragging a colloidal 

particle in a fluid, and an electric field acting on a molten salt. Under adiabatic 

conditions {i.e. the rate of heat exchange with the reservoir is Q = 0), the 

combined action of both kinds of external agents, i.e., a time dependent potential 

represented by a A-parameter and a dissipative field Fg, results in the equations 

of motion, 

dp 

P = -^^^ + D(r).Fe(.), (6) 



with Ti.{T, s) given by eqn. 5[ 



For an externally driven adiabatic system, the rate of increase of TC must be 
identically equal to the rate of work W done on the system by the environment. 
Thus, 

H'(r,.) = H-(r.», = A'^ + c,^»?^ + p.MM, (7) 

where the superscript ad emphasises adiabatic conditions. Using eqn. [6j we ob- 
tain, 

W{T,s) = x'^^^-VJ{T).F,{s), (8) 
where V is the volume of the system, and J(r), the dissipative flux due to the 



^ We must point out here that the notation does not imply that Fe is a "force" , and neither 
does it have to always be a vector. For example, it could be a second order tensor, such as the 
velocity gradient tensor in a fluid. The coupling tensors C and D are functions of T and have 
no explicit time-dependence, and are formally one tensorial order higher than Fe. 
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field Fe(s) is formally defined through the equation: 

^,.,.._(^.C.F..f .D.F,), (0) 

In the case of small systems such as protein motors or artificial nanomachines, 
it is quite difficult to thermally isolate the system to achieve perfectly adiabatic 
conditions. Moreover, in most applications of interest, such systems typically 
function in an environment of constant temperature. Molecular dynamics simu- 
lations of small systems have employed "thermostats" which involve appending 
eqn [6] with a mathematical constraint to fix the temperature T. For example, 
with a Gaussian isokinetic thermostat, eqns. [6] take the form ([2l|: 

- = ™ + c(r).F.(., 

P = -^!^^^l^+D(r).F,(s)-a(r)S.p. (10) 

Here, a is a thermostat multiplieij^ and S is a diagonal matrix (with I's and O's on 
the diagonal) that describes which components of the system are thermostattecQ 
Several other mathematical constraints can be constructed, all of which may 
be argued to be "artificial". We will discuss the implications of such artificial 
thermostats, and the constraints they must satisfy shortly. 

As the system is closed, an increase in the internal energy must equal the sum of 
work done on the system by the environment and the heat added to the system by 



^In the case of a Nose Hoover thermostat! 22 1, a becomes an additional independent variable 
and is a function of time governed by an additional equation rather than a direct function of T 



(|21l. 

When the external field is removed, Fe — 0, and the potential's parameter is held 



fixed, A = 0, the equilibrium these equations, eqn 10 will relax to is given by /eg(r) = 
cxp(-/3H(r,A)) ^|-p . s . p _ 2mK), where the Dirac delta function accounts for the kinetic en- 
ergy of the thermostatted particles being held fixed to the value K and m is the particle mass. 
The partition function is given hy Z = J dT exp(— /37i(r, A))5(p ■ S ■ p — 2mK). 
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the thermostat. However, it is clear that the functional form of the expression for 

the rate of work must still be given by the relation in eqn. [8] regardless of whether 

the system is thermostatted or not. From the First Law of Thermodynamics, the 

expression for the rate of heat exchange is Q = li. — W, with W given by eqn. jsj 

The actual expression for the rate of change of Q depends on the mathematical 



form of the thermostat. For the thermostat represented in eqn. 10 



Q(r,s) = -a(r)^.s.p. (11) 

The total work done on a closed system is hence, 

W = /(A5*|^-FJ(r..).F.w)d.. (12) 

and the heat added to the system is Q = — JqQ ds. We note here that the 
integrals above are path integrals. However, since the dynamics described by 



eqn. 10 are completely deterministic, W and Q are functions solely of the initial 
point in phase-space at s = 0, and the duration t. That is, W = W{To,t) and 
Q = Q{To,t). 

Consider a particular trajectory initiated at time s = at Fq = (qO)Po)) that 
terminates after time t at Fj = (q^, p^). Let dTg represent an infinitesimal volume 
of phase space at time s about the point F^. As the dynamics is deterministic, the 
trajectory is completely determined by the phase space coordinates at any time 
s along the trajectory, and the duration or observation time, t, of the trajectory. 
Consequently, for every initial state within a volume element dTo there exists a 
unique destination point within volume element dTt- As the trajectories in an 
infinitesimal bundle around the initial state, dFo, form the later bundle dTt, the 
ratio of the volumes of the infinitesimal volume elements vary as 



dTt 



dTc 



SVjT t) 
dV{T 



^=exp(^^ A(F,)(is)., (13) 
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Here dTt/dTo is the Jacobian of the transformation of the initial Tq to the final 

Tt, and 

A(r,..).g^.f,= (|., + |.p)_, (14) 

is the phase-space compression factor. It is noted that the integral on the right- 



hand side of eqn. 13 is also a path-integral. 



Equations 13 and 14 show how the volume of a small region of phase-space 
changes as it evolves in time. For adiabatic systems, there is no change of phase- 
space volume along a trajectory, and we require that A"'^ = 0. From the equations 
for an adiabatic system (eqn. [6|, and the definition of A above, we see that the 
field Fe and the coupling tensors C and D must be such that 

|.C.F.= |.D.F. = 0, (15) 

irrespective of whether the system is thermostatted or not. This condition is 
known as the Adiabatic Incompressihility of Phase-Space (AIF). However, for 
thermostatted systems in a driven steady state, a contraction of phase space 
occurs continually, as the initial phase volume shrinks to a fractal attractor of 
lower dimension than the ostensible phase-space. For appropriately selected ther- 
mostat^ the phase-space contraction factor is directly proportional to the rate 



of heat exchange with the thermostat (23,24), 



Q{T,s) = kBTK{T,s). (16) 

Since the same exclusive set of trajectories passes through both the phase 
volumes dTo and dT^, the differential probability measures of the two infinitesimal 



^ These include the Gaussian isokinetic thermostat and the Nose-Hoover thermostat. How- 
ever, we note that eqn. [14] has to be extended in the case of the Nose-Hoover thermostat as 
detailed in Ref. (I2TI). 
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volumes must be identical: 



dP{dT 0,0) = dP{dTt,t) 
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(17) 



We can express the probability measure P in terms of the probability density / 



as 



dP{dTs,s) = f{Ts,s) 6V(T,), 



(18) 



where f(Ts, s) is the time-dependent phase space probability density. The obser- 
vation that the probability measure is conserved in phase-space also leads to the 
Liouville equation for the probability density: 



df{r,s) ^ ^ df{T,s) ^ ^df{T,s) 



ds 



(9q 



dp 



-/(r,s)A(r,s). 



(19) 



We can recast eqn. 19 into the following Lagrangian form: 



dln/(r,s) 



ds 



-A(r,s), 



(20) 



from which it can be shown that 



f{Vut) = f{To, 0) exp A(r„ s) ds^ . 



(21) 



This equation is also obtained directly from eqns. 13 17 and 18 



One may enquire about the effect of the introduction of fictitious thermostats 



in eqn 10 and the possible introduction of artifacts (21 25). As mentioned above 



eqn 16 ensures that the equations of motion correctly sample the appropriate 
equilibrium distribution function in the absence of Fg and when A = 0. We also 
know that these equations of motion do not introduce artifacts when used to de- 
termine the linear response of a system to a small external field Fg. Further, the 
equilibrium correlation functions used in the Green Kubo integrals are affected 
by the thermostat at most as 0{1/N) where is the number of particles. A 
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general description of a system that is driven past a linear response is difficult, 



and in the nonlinear regime, synthetic thermostatted dynamics as in eqn. 10 may 



produce artifacts. Moreover, Mori-Zwanzig theory (26 21 ) can no longer be com- 



bined with the Onsager regression hypothesis (21 1 to rigorously derive stochastic 
equations. To address this, we can arrange things such that the thermostat only 
acts on particles that are in a region, which is spatially far enough removed from 



the nonequilibrium process such that it remains in local equilibrium (27 4 23 28) 
A detailed theoretical and simulation study has shown how this approach can 
for an infinite family of thermostats, result in the same behavior for the sys- 



tem of interest ( 23 1 . Equations of motion for isothermal-isobaric systems with a 



thermostat and barostat which are external to the system of interest, have also 



been developed (28|. These developments are theoretically important because 
they allow the derivation of important theorems which require the condition of 
ergodic consistency, which will be discussed shortly. For driven systems a sat- 
isfying treatment requires a mechanism for heat exchange. The development of 
synthetic thermostats, which only act on regions removed from the system of 
interest, allows the ergodic consistency condition to be satisfied without intro- 
ducing artifacts when far from equilibrium. This outcome is not easy to arrive 
at by other means. 

3 Fluctuation Theorems from Deterministic Dynamics 
3.1 Evans-Sear les Fluctuation Theorem 

As mentioned in the Introduction, the Evans-Searles FT shows how irreversibil- 
ity emerges naturally in systems whose equations of motion are time-reversible. 
In order to fully appreciate the substance of this FT, we need to ffist define 
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two fundamental concepts: microscopic time-reversibility, and macroscopic irre- 
versibility. 

3.1.1 Microscopic Time-Reversibility The equations of motion in sec- 
tion [2] describe the time evolution of a point, F, and may depend explicitly on 
the tim^due to the possible time-dependencies of A and Fg. If the equations of 
motion are reversible, then there exists a time reversal mapping that transforms 
the point F = (q, p) to F* such that if we generate a trajectory starting at Fq 
and terminating at F^, then under the same dynamics, we start at F^ = (F^)* 
and arrive back at Fq = (Fq)* after time t. We refer to a trajectory and its anti- 
trajectory as a conjugate pair of trajectories. The time-average of properties that 
are even under the mapping will have equal values for the trajectory and its con- 
jugate, whereas the time-average of properties that are odd under the mapping 
will have values with equal magnitude, but opposite signs for the trajectory and 
its conjugate. For many dynamics, {e.g. Newtonian dynamics), the appropriate 
mapping gives F* = (q, — p). 

For the equations of motioiij^ eqn [g] or 10 to satisfy this condition we must 
havfEl 

H^,X{s)) = 0(q,A(t-s)), 



That is the equations of motion may be nonautonomous. 

''in the case of Nose Hoover equations of motion we have an extra degree of freedom due 

to the thermostat multipher, a{t). This phase space variable must be reversed along with the 

momentum upon applying the time reversal mapping T* . 

^Often there is an external symmetry, e.g. for a fluid we may be able to drive a process in 

the opposite direction and consider it equivalent to the original direction, such that we may 

consider the conditions C(r) • Fe(s) = C(r*) ■ Fe(i - s) and D(r) ■ Fe(s) = -D(r*) ■ Fe(t - s) 

to in effect provide time reversal symmetry. This is why the Evans-Searles FT can often allow 

protocols which have an odd time parity. 
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c(r)-Fe(5) 



c(r)-Fe(t-s), 



D(r).Fe(5) 



D(r)-Fe(t-s). 



(22) 



Let us now consider a system of particles whose overall equations of motion are 
time-reversible. As discussed above, for every trajectory that is initiated at Fq 
and terminates at F^ in a system with microscopically time-reversible dynamics, 
there exists a unique anti-trajectory that starts at the phase-space point F^ at 
s = and ends at Fq at s = t. The bundle of anti-trajectories at time t passes 
through the volume element dT^ centered about the point Fg. However, the size 
of the volume element dT^ is equal to that of dTt- Moreover, if there is a volume 
contraction from dFo to dTt as shown in Figure [T] then there is an equivalent 
volume expansion associated with the bundle of anti-trajectories. 

Given a system whose equations of motion are microscopically time-reversible, 
is the macroscopically observed behaviour reversible as well? As Kelvin and 
Loschmidt pointed out in the 1870's, because Newtonian equations of motion 
are microscopically time-reversible, for every trajectory there is a anti-trajectory 
which is also a solution to the equations. One might then conclude that micro- 
scopically time-reversible systems must also be macroscopically reversible. How- 
ever the Second Law of Thermodynamics stipulates that a macroscopic system 
evolves overwhelmingly in one, time-forward direction and is "irreversible" . The 
question of how microscopically time-reversible dynamics gives rise to observ- 
able macroscopic irreversibility, is indeed "Loschmidt 's Paradox". To resolve this 
paradox, we first need an unambiguous measure of "macroscopic irreversibility" , 
that is consistent with classical thermodynamics in the thermodynamic limit, and 
applies to microscopic time-reversible equations of motion. 
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3.1.2 Macroscopic irreversibility: the Dissipation Function A 

system is said to undergo a macros copically reversible process in the time in- 
terval < s < t, if 

1. the system is ergodically consistent. That is for every trajectory that ini- 
tiates at To, the starting coordinates of its respective anti-trajectory, T* 
is represented in the phase space of the system at s = 0, or equivalently, 
the probabihty density of the initial coordinates of anti-trajectories at time 
s = is non-zero: /(r^, 0) / 0, for all Vq. 

2. the probability of observing any bundle of trajectories, occupying an in- 
finitesimal volume, is equal to the probability of observing the conjugate 
bundle of anti-trajectories, or 

dP(dro,0) = dP(dn,0) . (23) 

The latter condition for macroscopic reversibility can be written more conve- 
niently in terms of the distribution function of the phase space: 



/(ro,o)di^(ro) = /(n,o)dF(r 



t) ! 



or, 



/(ro,o) 



1 . 



/(n,o) 

But, as mentioned earlier, the volume of dV* is the same as dTt- Hence, from 



eqn. 13 we see that eqn 23 a condition for macroscopic reversibility, becomes 

7(ro,o)- 



In 



/ K{Vs,s)ds = 0, (24) 



./(n,o). 

for any initial coordinate Fq. Indeed, a quantitative measure of irreversibility 
associated with a system with microscopically time-reversible dynamics over the 
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interval < s < t, 0,t may be defined as the inequivalence of eqn 24 



nt{To) = In 



'dP{dTo,Oy 



= In 



7(ro,o) - 

./(n,o). 



Jo 




(25) 



The dissipation function fit is completely determined for a deterministic trajec- 
tory by the initial coordinate, Tq, and the duration of the trajectory, t. We note 
here that the time-reversibility of the dynamics dictates that conjugate pairs of 
trajectories are characterised by the same magnitude of Oj, but of opposite sign: 



Furthermore, if $7^ = for all trajectories initiated anywhere in phase-space, then 
the system is in equilibrium and the probabilities of observing any trajectory and 
its corresponding anti-trajectory are equal. If J7t > for a trajectory, then the 
corresponding anti-trajectory is less likely to be seen, and if the ensemble average 
is greater than zero, {0,t) > 0, we have macroscopic dynamics moving in the 
"forward direction" . If {0,t) < 0, then we would have macroscopic dynamics in the 
reverse direction. Thus, {0,t) ^ 0, is the condition for macroscopic irreversibility. 
Our knowledge of the Second Law however seems to suggest that the arrow of 
time points unambiguously in one firm direction, accordingly 



We explain how this comes about next. 
3.1.3 The Evans-Searles FT We consider trajectories of duration t in 
phase-space by selecting all those initial coordinates Fq for which 0,t takes on 
some value A between A =b dA and thus obtain the probability density 




(26) 




(27) 




(28) 
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Upon recognising that Tq is merely a dummy variable of integration, we may 

write down the conjugate probability as, 

Pint = -^) = I drt 5[nt{Tt) + A]f{ri o). (29) 



Note that eqn 29 selects those trajectories which are conjugate to those which 



are selected by eqn 28 Using the definition of i^t in eqn 25 along with eqn 26 



and eqn 13 we have 

Pint = -A) = exp [-A] J dTo 6[nt{To) - A)f{To, 0), (30) 

which leads to the Evans-Searles Fluctuation Theorem (Evans- Sear les FT): 

Pj^t = A) 

P(17, = -^) =^"P[-^]' 
and using this we can average over all values of A to give the Second Law In- 
equality, > 0, ([5]). In the above derivation of the Evans-Searles FT it was 
assumed that : 

1. the dynamics is ergodically consistent with the initial distribution function 

2. /(r,0) = /(r*,0), and 

3. the dynamics are deterministic and microscopically reversible. 

For systems of particles, the third condition implies that the time-dependent A 
and Fe must have an even time-parity < s < t. These are sufficient conditions 
for the Evans-Searles FT to be valid, but the condition of microscopic reversibility 
can be relaxed to some degree, and stochastic versions of the Evans-Searles FT 
(19||7j) exist. 



What is the significance of the Evans-Searles FT? One of the most impor- 
tant consequences of the Evans-Searles FT is that it shows how macroscopic 



'if symmetry permits, an odd time parity is also acceptable. 
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irreversibility can eventuate from microscopically reversible equations of motion. 

As described above, the systems we are considering are microscopically time- 
reversible. The Evans-Searles FT defines the variable fit which is a time-averaged 
phase variable and is zero for all initial phases if the system is macroscopically 
reversible, but will be non-zero for some initial conditions if it is macroscopically 
irreversible. Furthermore, the Evans-Searles FT shows that {0,t) ^ for any 
ergodically consistent, microscopically time-reversible system, and only zero if 
the system is at equilibrium. The significance of the Evans-Searles FT has been 
discussed in (|4[[5|, and other features are discussed in Sections 3.4 below 

However, where does the irreversibility come from? In obtaining the Evans- 
Searles FT, it is assumed that the initial distribution function is known and then, 
typically, the response of this system to a field, Fg, or variation of A is considered. 
Thus, we make the assumption of causality. If, instead, we had assumed that the 
system ends in a known state, we would have obtained the result {0,t) < 0. 



Therefore the assumption of causality underlies the final result ( 29 1 . 
3.1.4 Dissipation Function for systems initially in a Canonical En- 
semble Similar to the work, W{To,t), the dissipation function can be ex- 
pressed in terms of a trajectory of duration t with initial coordinate Tq, i.e. 
r2i(ro). Analogous to W, we restrict ourselves to trajectories initiated at equilib- 
rium in the canonical ensemble and consider the action of both, a time-dependent 
A-controUed potential where A(s = 0) = ^4 initially and A(s = t) = B finally, as 
well as a time-dependent dissipative field. Eg. For the definition of the dissipation 



function, eqn 25, becomes 



In 



feg{To,X = A) 
fe,{T*,X = A) 



dsA(Ts,s) 



(32) 
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= P[niT*,X = A)-HiTo,X = A)]-p ['dsQiTs,s). (33) 

Jo 

Noting that the coordinates of the trajectory and anti- trajectory, Tg and F*, 
differ only in the direction of momenta, p, and that Ti. is even in momenta, the 
LHS can be cast as a time integral over the trajectory. 



a 



so that 



:(ro) = r 

Jo 



ds 



TiiTs, A(s)) - QiTs, s) - </)(q, \{s)) + </.(q, A = ^) 



M^o) 



f 

Jo 



ds 



H'^^Ts, X{s)) - </.(q, A,) + </>(q, A = ^) 



W{To,t) - / ds 
Jo 



(q, Xs) + <P{(l,\ = A) 



or explicitly in terms of the potential and the external field as. 



nt{ro) = p f ds 

Jo 



- J-FeF + q 



9(/.(q,A(s)) d4>{ci,\ = A) 



5q 



5q 



(34) 
(35) 



(36) 



3.2 Crooks FT for Deterministic Dynamics 

We can generate probability distribution functions for W , which is the work done 
on the system, be it in terms of a parametrically. A, dependent potential or a 
dissipative field, Fg, in the same way that we generated probability distributions 
in section 2 for 

In contrast to the Evans-Sear les FT, the Crooks FT considers the probability 
of observing trajectories from two different equilibrium states. The probability 
density for a trajectory of duration initiated at equilibrium with A = ^, is 



Pf{W = A)= f dVo S[W{To, t) - A]feq{ro, A = A), 

JDa 



(37) 



where W^(ro, t), denotes the work done over a trajectory of duration t, initiated at 
Fq, and /eq(Fo, A = A) is the equilibrium distribution in the canonical ensemble. 
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Now the reverse trajectory or anti-trajectory starts at coordinates F^, and is 

guaranteed under deterministic dynamics to give a value of work that is equal 

and opposite that of the forward trajectory, see Figures |2] and [3| In this case, 

the reverse trajectory must also initiate under equilibrium conditions, however 

with X = B, and the time-dependence of the parameter A and field Fe must be 

reversed compared to the forward trajectory. 

So, the probability density for this reverse trajectory is 



p,{W = -A)= I dV*^5[W{V*„t)+A]feci{Tl\ = B). 



(38) 



At this point is it useful to note that if the system is driven strongly, i.e. far- 
from-equilibrium, the destination coordinate in the forward trajectory. Ft, may 
not be significantly weighted in the equilibrium distribution associated with the 
initial coordinates of the reverse trajectory; or in other words, 

exp[-/3WA=B(Ft)] 



Zb 



(39) 



may be very small. That is, the reverse trajectory can be "rare", creating a 
difficult challenge in sampling the distribution PriW = —A) in the Crooks FT, 
causing the convergence of the ensemble average in the Jarzynski Equality to 



become very slow (30 31 32,33 34 1 . Recasting 7i\=B in terms of the work done 



on the system, using the first law, i.e., 



w{T;,t) 



-wiro,t) 



Wa=a(Fo) — 'H\=B{^t 



+ kBT f dsA{s), 
Jo 



and noting that Ti is an even function of the momenta, i.e. Ti.\{Tl) = 7i\{Ts 



we see, 



fe,{TlX = B) = ^fe,{To, X = A) exp 
Zb 



f3W{Tlt) 



5V{r*) 
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where we have used the phase space compression factor given earher. Now 

SV{Tl) = SV{Ts) and the Jacobian is such that, 



Pr 



{W = -A) = ^ I dTo S[W{T; ,t) + A] exp 
J Da 



(40) 



Furthermore, as forward and reverse trajectories have equal but opposite values 
of W under time-reversible dynamics, W(ri^t) = —W{TQ,t), thus 



PriW = — A) = exp 



- P{AF - A) 



f drt6[w{Tt,t)-A]feq{rt,x = A). 

JDa 



The integral on the RHS can be identified as pf{W = A), resulting in the Crooks 
FT: 

Pf{W = A) 



exp 



p{AF - A) 



(41) 



PriW = -A) 

In the above derivation of the Crooks FT for the deterministic system it was 
assumed that : 

1. the dynamics is such that any phase point T for which /(r,A = A) ^ 0, 

2. /(r,0) = /(r*,0), and 

3. when the time evolution of A and Fg are reversed, the dynamics remain 
deterministic and microscopically time-reversible. 

These are sufficient conditions for the Crooks FT to be valid, but the condition 
of reversibility can be relaxed to some degree, and stochastic versions this FT 
exist. 



3.3 Steady-State Fluctuation Theorems 

Thus far, we have focused upon FTs that apply to a system driven out of an initial 
equilibrium state by an external field, characterised by Fg, or a parametric change 
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in the potential characterised by A 7^ 0. Indeed, the Evans-Searles FT apphed 

to systems driven from a known initial state over transient trajectories, is often 

referred to as the Transient Fluctuation Theorem (TFT). However, according 

to the derivations of the Evans-Searles FT, the initial phase-space distribution 

is not restricted to time-invariant or even equilibrium distributions. The only 

requirement the Evans-Searles FT places on the initial distribution function is 

that it is known and expressible in the ostensible dimension of the equations of 

motion (This is not the case for Crooks FT). Here we consider the FTs applied 

to trajectories under a steady-state; i.e., the system is acted upon by a purely 

dissipative, constant external field, Fg. 

There are two Steady-Sate Fluctuation Theorems (SSFTs) that appear in the 



literature. Both can be traced back to the original paper on FTs (35 36) that fo- 
cused upon isoenergetic equations of motion; but it is only later that two separate 
theorems were distinguished: (i) the steady-state version of the Evans-Searles FT 
(|4| and (ii) the Gallavotti-Cohen FT ([37|. 

3.3.1 The Evans-Searles Steady State Fluctuation Theorem (SSFT) 
In its simplest formulation, the SSFT of Evans & Searles involves a rearranged 
from of eqn [T] applied in the long time limit to trajectories of a system wholly 
in a nonequilibrium steady-state; i.e. the distribution function is time- invariant. 
A more complete derivation of the SSFT valid under conditions including the 



decay of correlations is available ( 38 1 ; however here we provide a simpler presen- 
tation that is physically compelling, and suitable for those primarily interested 
in a scientific justification. 

The argument of the Evans-Searles FT, applied to the steady state is 

'dP{dTo,Oy 



Of(ro) = In 



dP{dT*,0) 
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7^^(ro,o)- 



In 



f\{Ts,s)ds (42) 
Jo 



where f^^{dTQ,0) is now the phase-space distribution function associated with 
a steady-state, rather than with an equihbrium state (as in the Evans-Searles 
FT apphed to transient trajectories). However, typically this definition of is 
difficult to to implement. Firstly, steady-state distribution functions for the types 
of deterministic dynamics under consideration are not generally known. What 
is known is that, in the steady-state, the dynamics approach a strange attractor 
that has a different fractal dimension to the ostensible phase space. Even if we 
knew the details of this attractor, it would still be difficult to apply the Evans- 
Searles FT as it describes bundles of phase-space trajectories in the phase-space 
dimension and not in the dimension of the strange attractor. Note however, 
that there are special cases where these steady-state distribution functions can 
be expressed simply and exactly under stochastic equations of motion, and eqn 
[T] may be applied ( 39 1 . 

In general these steady-state distribution functions are not known, and conse- 
quently, it is not possible to construct exact expressions for 17** for deterministic 
trajectory segments of duration t that are wholly at a nonequilibrium steady- 
state. However an approximate steady-state dissipation function can be con- 
structed from trajectories initiated at a known equilibrium, in the absence of 
the dissipative field, Fg. This distribution function is often referred to as the 



Kawasaki distribution function (21), and can be considered to form the basis of 
the formal proof(38). At time t = 0, the dissipative field is introduced, and we 
can express 0,t associated with this trajectory in terms of its instantaneous rate 
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of change, at time s: 

nt = J^dsn{s) + dsn{s). (43) 

Here, r is some arbitrary long time, say several Maxwell times, so that the fluid 
has completely relaxed into a steady-state. Thus, Clt is cast as a sum of transient 
and steady-state contributions with the steady-state contribution, identified as 
the steady-state dissipation function, fif*, used to approximate Clt with an error 
or order 0{t) . It is instructive to express these dissipation functions as time- 
averages, = rit/t such that 

^^t + o(^-\. (44) 



t 

We make the physically compelling argument that, in the long time limit, the 
distribution function for steady-state trajectories will asymptotically converge to 
that for the full transient trajectories: 

limp-(On=M^t)- (45) 
t— *oo 

However, the fluctuations in also vanish in the long time limit, and, in order 
that the SSFT be of any importance, it is necessary that these fluctuations vanish 
more slowly than O^r/t), the error in the approximation. To argue that this 
is the case, we re-express fif* as a sum over contiguous trajectory segments of 
duration At: 

= ^E^A*. (47) 

i=l 

If At is larger than the longest correlation time in the system, then the sum X] ^At 
is composed of independent segments and the variance in the sum is proportional 
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to the number of segments or t/At. The factor 1/t in front of the sum decreases 

the variance of the sum by a factor t"^. Thus, the standard deviation of the steady 

state dissipation function, Of^, along a steady-state portion of a trajectory is 

inversely proportional to \/t, and decays at a slower rate than that of the error in 

the approximation of 0,t with Consequently, we can approximate 0,t in the 

FT, eqnjl] with the steady-state dissipation function Of*, leading to the SSFT 

lim^ln4p^^=A (48) 
t-oo t p{9.t = -A) ^ ' 

3.3.2 Gallavotti- Cohen FT The fluctuation relation of the Gallavotti- 
Cohen FT can be written 

M^hn44^^=A, (49) 
t^oo t p{-At = -A) ^ ' 

where the average phase space compression factor (or the divergence of the flow) , 
measured in the steady state, is given as 



1 



At = - dsA{s) 
t Jo 

AW = |.-r. 

The original proposal of this FT ('35') was made for the special case of isoener- 
getic dynamics, for which 0,(T) = — A(r). However, subsequently the work of 
Gallavotti and Cohen ( [37p0l ) strongly suggests that under appropriate conditions 
(and with a restriction on the values of A (|4l|^'^| can be applied to a larger 



eqn 



49 



class of dynamical systems (e.g. constant temperature systems). They arrived at 



eqn |49| through a formal derivation (37 40 1, which drew upon the Sinai-Ruelle- 
Bowen (SRB) measure (for a discussion see (|43j)), which requires the dynamics 
to be an Anosov diffeomorphism (M4|rM A necessary but insufficient condition 



Eqn 49 is restricted to values of A bounded by a value A*. A G {—A*,A*). In the small 



field limit this value is given to leading order as A* = + 0{F^) (42 I. 

^^An Axiom A diffeomorphism will also suffice for the Gallavotti-Cohen FT. 
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for this is that the dynamical system must be hyperbohc (43). This means that 
the number of expanding and contracting directions on the attractive set must 
be equal, or in other words the number of positive and negative finite time Lya- 
punov exponents must be equal and no zero exponents are allowed. In general, 



the equations of motion, eqn 10 do not form an Anosov diffeomorphism. To ad- 
dress this Gallavotti and Cohen introduced a new hypothesis, termed the chaotic 



hypothesis (45), which, for the purposes of the Gallavotti-Cohen FT, allows 
many-body dynamics to be treated as an Anosov diffeomorphism. Unfortunately, 
as yet, there is no way to independently ascertain if a physical system may be 
treated as Anosov diffeomorphic. The requirements for the valid application of 
the Gallavotti-Cohen FT to physical systems are therefore extremely difficult to 
establish. 

There is a large body of computer simulation results, for various processes, that 
have tested the steady state fluctuation theorems, e.g. (|35|[36][l9)[27)|46]|47||48] 

We known of no case for which the Gallavotti- 



13 



Cohen FT converges faster than the Evans-Sear les FT. For temperature regulated 
dynamics, when the dissipative field strength is very small, the Gallavotti-Cohen 
FT can take extremely long times to converge. Indeed as the dissipative field 
strength approaches zero the amount of time it takes the Gallavotti-Cohen FT 



to converge diverges (58 42). To understand this consider the arguments of 
the Evans-Searles FT and the Gallavotti-Cohen FT. When the field strength 



'^^Quoting form (45 1, "Chaotic hypothesis: for the purpose of studying macroscopic properties, 

the time evolution map 5* of a many-particle system can be regarded as a mixing Anosov map." 

In |37|40| ) the term "transitive Anosov map" was used to mean "mixing Anosov map" . 

^ i'here are results in the literature which test the Evans-Searles FT while erroneously claiming 

to test the Gallavotti-Cohen FT. 
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approaches zero so does the instantaneous dissipation function. More precisely 

the average value of the instantaneous dissipation function, to leading order, is 

n{r) = + 0{F^), and the standard deviation is a = + 0{Fe). For the 

phase space compression factor, the mean is A = + 0(^2) and the standard 

deviation is cr = ctq + 0{F^), where do is the amplitude of the standard deviation 

at equilibrium. The difference between the behaviour in the amplitude of the 

fluctuations, a, for these two quantities is crucial. As Fg approaches zero so to 

does the amplitude of the fluctuations in Q but not those in A. Now the form of 

the fluctuation formulae is asymmetric. In the limit Fg — > 0, eqn|48](the SSFT) 

remains consistent with a given trajectory segment being equally likely to occur 

as its anti-trajectory segment. This is a necessary condition for equilibrium. In 



contrast eqn 49 (the Gallavotti-Cohen FT) is not consistent with this, due to the 
fluctuations in A remaining finite when Fe ^ 0. One way this could be resolved 
is for the time averaging, or the time for which the Gallavotti-Cohen FT is given 
to converge, to be so long that there are no significant fluctuations remaining. 
However it is specified by the theory (42) that the largest fluctuations for which 
the Gallavotti-Cohen FT may be validly applied vanishes in the small field limit. 

3.4 The Einstein Relation and Green Kubo Theory 

The Evans-Searles Fluctuation Theorem, as well as Crooks Fluctuation Theo- 
rem have been reviewed here as recent theorems in nonequilibrium statistical 
mechanics. Here we show that the FTs, and in particular the Evans-Searles FT, 
is completely consistent with the long-standing and well-known relations in the 



field, namely the Einstein-Sutherland relation (59 60,61) and the Green-Kubo 



Relations. The Einstein-Sutherland relation dates back to the very early days of 
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non-equilibrium statistical mechanics; it can be written as 

(v)^^ = (3DFe. (50) 

This important relation describes the average steady-state velocity of a particle, 
(v)^^, under an applied field, Fg, to the variance in the particle's displacement 
over time in the absence of the field, which is commonly referred to as the diffu- 
sion constant, D = lim^^oo (^2;(t)^)Q /(2t), where Ax{t) = Jq ds x{s). Starting 
from the Evans-Sear les FT, we reformulate a generalised form of this Einstein- 
Sutherland relation, and from that, the Green-Kubo relations. While this does 
not produce new results, it demonstrates the FTs' consistency with important 
existing theorems in nonequilibrium statistical mechanics, and it also empha- 
sises/clarifies the conditions necessary for the application of these theories, as we 
show later, in the case of supercooled liquids. 

To derive the more generalised version of the Einstein-Sutherland relation, eqn 



50 from the FT, we first need to identify the product of the particles' drift 
velocity and the applied field, — Fg • v(t), as a specific example of a dissipative 
field flux, that we have represented by JV ■ Fg, which, in the case of the flux and 
constant field being in the same direction, we write more simply as JVFe. Under 
steady-state, the time-averaged dissipative flux is defined as 

1 /■^+* 

Jt = - ds J{s), (51) 



t Jr 

where r is a time long enough after the application of the field so that the system 



is at a steady-state. The steady-state fluctuation theorem, eqn [48] may then be 
written as 

hm ^ In = -PVF^A. (52) 

t^oo t F[Jt = —A) 

In the limit of long time, we may invoke the central limit theorem, which states 
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that close to the mean the distribution of Jt will be Gaussian. Additionally in 

the limit of small field strength, values of Jt close to the mean will dominate: 

, 2 



P{Jt = A) = ^exp I ^ I , (53) 



1 



Now as the variance in the distribution of Jt is independent of the field direction 
or sign of Fg, then, to leading order in Fg, the variance behaves as 

=al + (f!) = ( J2)^ + O (f^) . (54) 



The SSFT, eqn 52 the central limit theorem eqn 53 and eqn 54 combine to give 
a generalised Einstein-Sutherland relation: 

(J)^^ =£m -^/3FFe(j2)^t + 0(F2), (55) 

It is generally known that the Einstein-Sutherland relation is only valid to 
linear order in the field, Fg- However, the FT provides more detailed under- 
standing of how this relation fails under large fields. When the field is increased, 
the mean dissipative flux, {Jt) will also increase. Figure [4| When the mean is 
large relative to the standard deviation, then for every typical value of the flux 
Jt = its conjugate value Jt = —A in the SSFT will be represented in the 
wings of the distribution where the central limit theorem no longer applies. In 
this instance, the generalised Einstein-Sutherland relation is invalid, even if the 
equilibrium variance {Jt)o is replaced with the variance under steady-state, or 
{Jt)Fe- Molecular dynamics simulations of planar shear have shown that the 
breakdown of the central limit theorem dominates over the approximation of ig- 
noring terms of 0{F^) or higher in the variance that describes the distribution 
near its mean. (|47|). In the case of a single, tagged particle, interacting with 
a constant field, and embedded in a supercooled liquid, the amount of time it 
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takes for the the steady-state FT to converge as well as the the time it takes 

for the distribution to become Gaussian, increases rapidly upon approach to the 



glass transition (62|. Moreover, the variance decreases with time. As this time 
increases the variance decreases inversely proportionally. As the nominal glass 
transition is approached the strongest field for which a linear response may be 
observed in the steady state, vanishes. 

The variance of the flux may be expressed in terms of the integral, 

(•^Oo = ^ 1^ du {J{s)J{u)), (56) 
2 2 



, ds (J(0) J(s))o - -2 / dss{JiO)J{s)),. (57) 

t Jo Jo 



In the long time limit, the second term on the RHS vanishes and 



lim (J?)=j fds {J{0)J{s)),. (58) 

t^oo \ / t Jo 



Combing this with the generalised Einstein-Sutherland relation, eqn 55 gives the 
celebrated Green-Kubo theory for steady-state: 

(J) = -pVFelim fds {J{0)J{s))o (59) 

t^oo Jq 

It can be used to obtain a transport coefficient in terms of equilibrium fluctuations 
in the form of an autocorrelation function. One might wonder why the Green- 
Kubo theory holds such important status given that the presentation here shows it 
to be equivalent to the Einstein-Sutherland relation. In contrast to the Einstein- 
Sutherland relation the Green-Kubo theory is also applicable to time dependent 
phenomena. A time dependent version of the Green-Kubo theory cannot be 
obtained from the FT which must satisfy definite time parity conditions. 

An example of where the FT has been used is Couette flow or planar shear 



(35 47| using the SLLOD equations of motion(21|, which in the absence of a 
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fictitious thermostat and for the case of constant shear rate 7, are equivalent to 

Newtons equations of motion. As we are controlling the shear rate externally we 

identify it as the external field Fg = j and the flux as J = Pxy, where Pxy is the 

xy element of the pressure tensor. The dissipative field or entropy production for 

Couette flow is then 

JVFe = WPxy (60) 

The shear viscosity rj is the rate at which work is being done on the fluid divided 

by the product of the volume and the shear rate squared. The Green Kubo 

expression for the viscosity is thus 

— (P ) r°° 
ri = =PV dt {Pxy{0)Pxy{t)), , (61) 

1 Jo 

and the Einstein-Sutherland expression is 



If the system is very viscous, the Green-Kubo expression, eqn 61 will require 



a long time to converge and consequently, the generalised Einstein-Sutherland 



expression, eqn 62, will probably be the better method to extract the viscosity 



in such a situation (63). In contrast, if we wish to calculate the self-diffusion 



coefficient for a very viscous system, the Einstein-Sutherland expression for the 
diflFusion (^Ax{tf)^/{2t), can be very slow to converge while the Green Kubo 



expression, D = ds {v{0)v{s))q, will usually converge quite rapidly (64|. 



4 Applications of Fluctuation Theorems to Experimental & Model 
Systems 

Much of the work done in developing and extending the Fluctuation Theo- 
rems was accomplished by theoreticians and mathematicians interested in non- 
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equilibrium statistical mechanics. Until 2002, demonstrations of the theorems 

were limited to computer simulations and there were no practical experimental 
demonstrations of the theorems, despite the range of interests in nano/micro 
machines, or molecular devices that impose nanometer scale displacements with 
picoNetwon scale forces. Such small machines include single biomolecules that act 
as molecular motors and whose experimental observation highlight the nonequi- 
librium phenomena described by the FTs. Linear motors, such as the action- 
myosin or the kinesin-microtubule motor are fuelled by proton currents or ATP 
hydrolysis and function as integral parts of cellular metabolism, and consequently, 
they work under inherently nonequilibrium conditions (65 J. Over time, on aver- 
age, these molecular engines must not violate the Second Law; however occasion- 
ally they run "backwards", converting heat from the surroundings to generate 
useful mechanical/chemical energy. This work, done on the molecular time and 
length scales, will have a natural variation or spread of values, and the conjecture 
is that this is governed by the FTs. 

In 2002 the FTs were demonstrated experimentally by two independent groups. 



each with a unique focus and both using optical tweezers. Wang et (66 1 demon- 
strated the Evans-Searles Fluctuation Theorem by monitoring the transient tra- 
jectory of a single colloidal bead in a translating optical trap. Simultaneously, 



Liphardt et al( 67 1 , used optical tweezers to pull the ends of a DNA-RNA hybrid 
chain, measuring the work required to unravel or unfold a specific domain in the 
chain. These experiments had complementary aims: The colloidal experiment 
was a classical model system constructed to cleanly demonstrate, as rigorously 
as possible in experiment, the Evans-Searles FT. In contrast Liphardt's RNA- 
unfolding experiment importantly demonstrated the application of Crooks FT to 
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a complex biomolecular system, highlighting the potential practical use of FTs 

to a wider range of scientists. In this section we review both experiments in some 

detail before more briefly mentioning other more recent experimental applications 

of the FTs, as well as other proposed experimental systems and implications. 

4.1 Single Colloidal Particle in an optical trap 

An optical trap is formed when a transparent, micron-sized particle, whose index 
of refraction is greater than that of the surrounding medium, is located within a 
focused laser beam. The refracted rays differ in intensity over the volume of the 
sphere and exert a subpico-Newton force on the particle, drawing it towards the 
region of highest intensity, i.e., the focal point or trap center. The optical trap 
is harmonic; a particle located a distance r from the center of the trap has an 
optical force, fopt = —kr, acting to restore its position to the trap center, k is the 
trapping constant which is determined by the distribution of particle positions 
at equilibrium and is tuned by adjusting the intensity of the laser. Using an 
objective lens of high numerical aperture, the optical trapping is strongest in the 
direction perpendicular to the focal plane, such that particle remains localised 
entirely within the focal plane, fluctuating about the focal point. As the particle 
position r is measured at mHz frequency, i.e. over timescales significantly large 
that inertia of the colloidal particle is negligible, the measured optical force, fopt, 
balances any applied forces, either forces arising from the surrounding solvent, 
such as Brownian or drag forces, or the tension associated with a tethered chain 
molecule such as DNA or RNA. 

The first experiment that demonstrated the Fluctuation Theorems was carried 



out by Wang et al (66). They monitored the trajectory of a single colloidal par- 
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tide, weakly held in a stationary optical trap that was translated uniformly with 
constant, vanishingly small velocity Vopt starting at time s = 0. Initially, the par- 
ticle's position in the trap is distributed according to an equilibrium Boltzmann 
distribution with an average particle velocity of 0. With trap translation, the 
particle is displaced from its equilibrium position until, at some time later, the 
average velocity of the particle is equal to the velocity of trap. Prom this point 
the system is in a nonequilibrium steady state. To determine the dissipation 
function, consider that the the external field is purely dissipative, i.e. A = 
and Fg ~ Vopt, so that the dissipation function is 



With the ability to resolve nanometer-scale particle displacements and femtoNew- 
ton scale optical forces, fl{s) was determined with sub-fe^T resolution. As there 
is no change in state of the underlying state of the system, and the field has even 
time-parity, the Evans-Searles FT and the Crooks FT reduce to the same ex- 
pression and equivalently describe the distributions of ilt = W. We expect, from 
the Second Law, that work is done to translate the particle-filled optical trap, or 
W > 0, but according to the FTs there should also be a nonvanishing probability 
of observing short trajectories where W <0, that is thermal fluctuations provide 
the work. Indeed, Wang et al showed trajectories with = fij < 0, persisted 
for 2-3 seconds, far longer than had been demonstrated by simulation. However, 
in this initial 2002 experiment there was an insufficient number of trajectories 
to properly sample the full distribution, p(fit), and the authors instead tested a 
coarse-grained form of the Evans-Searles FT, the integrated Evans-Searles FT: 




(63) 



p{^t < 0) 
p{^t > 0) 



(exp[-ni])oj>o 



(64) 



Fluctuation Theorems 39 
where the brackets on the RHS denote the average over that part of the distribu- 
tion for which il^ > 0. Later, Wang et al (39{ ) revised this same experiment, and 
sampled a larger number of trajectories, enabling a direct demonstration of the 
Evans-Searles FT with a purely dissipative field. Moreover, they also translated 
the particle-filled optical trap in a circular or "race-course" pattern, producing 
one long single trajectory, which outside of the initial short time interval, was 
steady-state. Using contiguous segments of this single steady-state trajectory. 



they demonstrated the steady-state version of the Evans-Searles FT ( 39 ) . 

A particle in an optical trap was also used to demonstrate the distinction 
between the Evans-Searles FT and the Crooks FT, in the so called "capture" 



experiment (68 69). In this single particle experiment, the strength of the sta- 
tionary optical trap, or the trapping constant k, is changed instantaneously, and 
the time-dependent relaxation of the particle position from one equilibrium dis- 
tribution to another distribution is recorded. For this experiment, a particle is 
localised in a stationary trap of strength /cq over a sufficiently long time that its 
position is described by an equilibrium distribution. At time s = 0, the optical 
strength is increased discontinuously from /cq to ki, ki > ko, so that we more 
tightly confine or "capture" the particle. Alternatively, we can decrease the trap 
strength from ki to ko, to "release" the particle. Thus, the external field param- 
eter, A, is the time- dependent trap strength, k(s), which varies discontinuously, 
A(s) = (ki — kQ)6{s), and in the absence of a purely dissipative field, or Fe = 0. 
The particle's position is recorded as it relaxes to its new equilibrium distribu- 
tion and the different functions W and 0,t are evaluated over an ensemble of 
nonequilibrium trajectories. 

Work is the change in the internal energy that occurs with the change in the 
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trapping constant: 

W= rdsX^ = l/2{h-ko)rl 

Jo uA 

Note that W will always be positive if the trap strength is ki > ko and conse- 
quently, distributions for W cannot be Gaussian. As all trajectories must initiate 
under equilibrium conditions under ko, the probability distribution of tq is a 
Boltzmann distribution and the distribution of W is then simply 

Thus, if we consider the ensemble average, (exp [— we would recover the 
Jarzynski Equality, or (exp [— = exp [— /3AF], where AF = ksTln [i/fci/fco] 
from classical thermodynamics. Furthermore, if we consider the probability dis- 
tribution of W for both the forward or capture direction, and the reverse or 
release direction, i.e., Wki-,ko, 

it is straightforward to show that these distributions trivially obey Crooks FT. 
Notice that in the context of the capture experiment. Crooks FT depends only 
upon the equilibrium distribution of initial particle distribution: these equilib- 
rium distributions are independent of, for example, the viscoelastic response of 
the suspending fluid. An alternative experiment, say where the trapping constant 
changes linearly over some time period is different; there W is accumulated over 
the time period over which k is changing and the distribution of W depends upon 
the response or microrheology of the fluid. 

In contrast, the dissipation function, Qf depends sensitively upon the non- 
equilibrium trajectory, and upon the material properties of the surrounding fluid 



koW 
ki - ko. ' 



kiW 
ko - ki_ ' 
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(70). The dissipation function is then 



- ^1 , 2 



t - •-0) 



dr dr 

Notice that if we consider a cychc protocol where the external field had even 
time-parity, i.e. X{s) = {ki — A;o)(5(s) — 6{t — s), that is, we would "capture" at 
s = and "release" at t = 0, then 0^ = W^Q^ki + W^fci-^fco) and the Evans-Searles 
and Crooks FTs would again reduce to the same expression. 

These experiments were simple, but important demonstrations of the FTs. 
These experiments can also be related to Fluctuation Theorems derived under 
stochastic equations motion, a topic not covered in this review. The motion 
of a single colloidal particle in a purely viscous solvent is accurately described 
by a stochastic Langevin equation; i.e., the degrees of freedom of the solvent 
molecules are integrated over the timescale of the colloidal particles' motion to 
yield a friction coefficient and un correlated Gaussian noise. As demonstrated by 



Wang et al (39 1, from the stochastic, inertialess Langevin equation of motion, 
you can construct the Evans-Searles FT in much the same manner as was done 
for deterministic dynamics. This is important evidence against the notion that 
macroscopic irreversibility is due to the coarse-graining or separation of time- 
scales of the system's degrees of freedom: for the optically-trapped particles, 
both Langevin equations of motion as well as fictitious thermostatted determin- 
istic equations (MD) showed the monotonic decrease in Qt as the trajectories 
evolved in time. On the other hand, if a system's dynamics are well described 
by stochastic Langevin dynamics, with uncorrelated Gaussian noise, then we are 
assured that the FTs will hold. Indeed, several simple model experiments, includ- 
ing optically trapped colloidal particles in purely viscous media, can be described 
using stochastic Langevin dynamics and consequently one could argue that these 
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experiments confirm the Langevin dynamics rather than the FTs. However more 

recently, Carberryet al, confirmed the FT using an optically trapped bead in a 

viscoelastic solvent, where the stochastic equations of motion require a dissipa- 

tive term with memory, from which the FTs have yet to be directly derived. This 

experimental confirmation is indeed a confirmation of the FTs, rather than a 

confirmation of the dynamics that satisfy the FTs. 

4.2 Stretching of Biopolymers 



In 2002 Liphardt et al (67 1 measured the tension-induced, unfolding transition 
of a P5abs domain in a single RNA molecule. To do this they tethered the ends 
of a single DNA-RNA hybrid molecule containing the P5abc domain to micron- 
sized colloidal beads whose surfaces were chemically functionalised. These beads 
act as "handles" to grab and manipulate the single molecule in an optical trap. 
One bead is weakly held in an optical trap while the other bead is held in a 
micropipette whose position/translational speed is controlled by a piezoelectric 
actuator. As the micropipette is translated relative to the optical trap, the chain 
is stretched and the tension in the chain is determined by the optical force, fopt 
acting on the bead in the trap. In this way, Liphardt et al constructed force- 
extension profiles of a single biomolecule, focussing specifically on a window of 
extensions over which the P5abs domain unfolded. Over a ~ 30//m extension 
range, they found that, typically, the force increased monotonically against the 
entropic elasticity of the chain's contour, but at ~ lOpN the force was either 
constant or decreased slightly for a further ~ lO/xm indicative of unfolding of 
the domain, before increasing monotonically again. The time-reverse path corre- 
sponds to retraction of the chain ends, creating the same force-extension profile 
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for the re-folding of the domain. When the chain was unfolded slowly (corre- 
sponding to small A), the folding- unfolding processes were reversible, i.e., the 
work done (force integrated over extension) of the forward (unfolding) and re- 
verse (re-folding) paths were roughly equal but of opposite sign. When the chain 
was unfolded quickly, a hysteresis loop appeared in the forward-reverse force pro- 
file and the W to fold and unfold differed in magnitude, due to the macroscopic 
irreversibility. Theoretically, the distributions Pf(W) and Pr(W) at any given 
protocol or stretching rate. A, should obey Crooks FT: however, it is clear that 
variation in W due to experimental error or approximations in analysis must be 
minimal in comparison to the inherent variation in W that arises from the irre- 
versibility of the process. Furthermore, it is important to experimentally sample a 
sufficient number of trajectories, N: as the protocol rate. A, increases and the pro- 
cess is driven further away from a quasi-static or equilibrium process, the required 
number N grows as "rare" trajectories in the distribution become important as 
explained in Figure [Sj Successive single molecule manipulations in an optical trap 
can be difficult, limiting the maximum possible number of trajectories. However, 
Liphardt et a/ constructed 0(300) stretching profiles, unfortunately an insufficient 
number to describe the distributions, but fortunately sufficient to the show that 
AF obtained from Jarzynski's equality could be determined to within UbT from 
their experimental trajectories. In later work from the same group, Collin et 



al{ 71 1 similarly used optical tweezers to construct experimental work distributions 
and demonstrate Crooks FT for the folding/unfolding of an RNA hairpin and an 
RNA three-helix junction. These results demonstrate that nonequilibrium single 
molecule measurements, when analysed in conjunction with the FTs can provide 
thermodynamic information, even though these single-molecule events may not be 
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at equilibrium. More importantly, these papers introduced to the single-molecule 

force spectroscopist, a proper analysis/interpretation of force measurements. 



4.3 Other model systems 

Several other more recent experimental demonstrations of the FTs have appeared 



in the literature in the last couple of years. Garnier and Ciliberto (72) demon- 
strated the FTs by measuring the fluctuating voltage of a resistor in parallel with 
a capacitor, driven out of equilibrium by a constant current flow; Schuler et al 



(731 excited a single defect center in a diamond using an intensity-modulated 



laser, forming a two-state system; and Douarche et al (74 75) , experimentally 
checked the Jarzynski equality and Crooks FT against the thermal fluctuations of 
a mechanical oscillator in contact with a heat reservoir. Applications of the FT to 
model systems need not be experimental. To date the FT has been used in the- 



oretical descriptions/computer simulations of sheared liquids i.e. (35), chemical 



reactions ( 76 77 78 ) molecular motors (79 80 ) , granular gases (^Ij , and glasses 



(162||82|). 

Finally, through its application to time-dependent shear of viscoelastic fluids, 
the FT has been used to resolve a long-standing problem in linear irreversible 



thermodynamics (83). The reference to JVFe as the entropy production is taken 
from linear irreversible thermodynamics, which asserts that, in local equilibrium, 
the entropy source strength is the sum of products of irreversible thermodynamic 
fluxes and forces (|2j[T]). By the Second Law we then expect that (J) is always 
negative. However for time dependent processes in viscoelastic fluids this is not 
always the case. In the steady-state the free energy F, the mean internal energy 
U, the temperature T and the entropy S will all be constant. In local equilibrium. 
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where the entropy transported to the reservoir is given by Str = Q/T, we have 

F = —JVFf. + Q — TS = 0. This leads us directly to the conclusion that JVFe = 

—TSsp, where Sgp = S — Str is the rate at which entropy is being spontaneously 

produced, due to the external field Fg. If we are not in the steady state or 

are not in local equilibrium we cannot show that, JVFe = —TSsp- Indeed for 

time dependent proccesses in viscoelastic fluids (J) may be positive for periods of 

time. For a system initially in equilibrium, subject to a purely dissipative process, 

i.e., A = V t, the time averaged value of the entropy production, rather than 

the more traditional instantaneous entropy production, can be shown from the 

Jarzynski Equality to form the inequality that specifies the time direction. This 

was demonstrated in simulations of time-dependent planar shear of viscoelastic 



fluids (831 where the instantaneus value of (J) was indeed shown to be negative 
for periods. Furthermore, this inequality is valid for time dependent processes 
which may be arbitrarily far from equilibrium. 

5 Conclusions 

This review has focused on two important fundamental fluctuation relations, the 
Evans-Searles and the Crooks FTs, with some discussion on steady state fluctua- 
tion relations (Evans-Searles SSFT and the Gallavotti- Cohen FT) and important 
relations that can be derived from these. The new understanding of thermody- 
namic reversibility that has been obtained from the FTs has been described in 
detail, as has the determination of free energy differences between equilibrium 
states from study of nonequilibrium paths. In this context the Jarzynski equality 
has been presented. 

However, there is much work on FTs that has not been covered in this review. 
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The theoretical description above has focused on systems whose equiUbrium equa- 
tions of motion preserve a canonical distribution function. This requirement is 
not necessary, and the application of the Evans-Searles FT to a wide range of 
combinations of ensembles and dynamics is well known (84 4]). Furthermore, 
the Crooks FT has been extended to allow treatment of other ensembles includ- 
ing constant pressure ensembles ([28j[85j|86]) . Granular systems ((87| and systems 
undergoing chemical reactions ( |88{[89{[90[|78[[53[ ) have also been studied. 

As discussed above, we have focused on deterministic derivations due to our 
interest in emergence of irreversibility from reversible equations of motion, how- 
ever there has been extensive work on stochastic versions of the Evans-Searles 



FT (see (20 19) for early work in this regard), and it is straightforward to see 
that the requirement of microscopic reversibility is not essential in its derivation 
- existence of the reverse trajectory is sufficient. The original derivations of the 
Crooks FT and the Jarzynski equality used stochastic dynamics, and it is only 



more recently that derivations for deterministic systems have appeared (91 92). 
As mentioned in the introduction, versions of FTs applicable to quantum systems 



have also been obtained (17 18 1 . 

Fluctuation relations for phase variables other than the dissipation function can 
be straightforwardly obtained for those phase variables that are odd with respect 
to time reversal. These relations are more complex than the dissipation-function 



FT (93,4 38 1 . Local fluctuation relations have also be derived (27 94 1 . 

Finally, as the functional form of the dissipation function in the FT depends on 
the initial ensemble of the system, satisfaction of an FT that is derived assuming 
a particular distribution function provides evidence that the correct ensemble had 



been assumed. This has proved useful in the study of glasses (82|. 
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Some experimental studies of the FTs have been discussed. These have allowed 

confirmation of the relationships in real physical systems. We see that a challenge 

now lies in applying the FTs to assist in the development of nanotechnology and 

to developing our understanding of biological systems. 
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Figure 1: An illustration of a set of neighbouring deterministic trajectories of 
duration time, t, (top tube) and their corresponding set of time-reverse or "anti- 
trajectories" (lower tube) in coordinate, momentum T = {q, p} and time, s, space 
where an external agent does work on the system. This external agent, either A- 
parameter in the potential energy, or a purely dissipative field, Fg incorporated in 
the equations of motion, must have even time-parity for the dynamics to remain 
time-reversible. For every trajectory that starts at Fq = {qoiPo} in the volume 
element 5Fo and ends at F^ = {qt,Pt} in volume element 5Tt at some time t 
later, there exists the anti-trajectory, whose coordinates, at any time s along 
the trajectory starting at s = 0, are given by FJ'_^ = {qt-s, — pt_s}. Thus, the 
anti-trajectory starts at F^ = {q^, —pt} in volume element (5F^ and terminates 
after a time s = t at Fq = {qo, — Po} in ^^o- thermostatted systems, if the 
action of the external agent does work on the system, there is a contraction of 
phase-space volume in time, i.e., 6Tt < 6Tq as represented in the figure by the 
shrinking of the tube's cross sectional area in time. As the equations of motion 
are time-reversible, the phase-space volume increases from s = to s = t and the 
size of the volume elements 6Tt and 5T^ are equal. 
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Figure 2: An illustration of a set of deterministic trajectories generated under 
the action of an external agent, where the agent does work on the system of 
magnitude W it dW. The external agent is represented as a time-dependent A 
parameter which controls the system's potential energy and equilibrium state. 
The trajectories are initiated under equilibrium conditions under a constant 
A(s = 0), say equal to A; the shading in the s = phase-space plane being 
representative of the equilibrium distribution, feq(T,X = A). Here we repre- 
sent a linearly time-dependent A which varies over the time interval < s < t, 
with W = £dsXdn/dX. We've illustrated a case where A is not applied quasi- 
statically; i.e., at time t when the field has attained its final value of A = i?, the 
system is far-from-equilibrium, and relaxes over t < s < towards to a new 
equilibrium state characterised hy X = B. The magnitude of /eg(r, X = B), the 
equilibrium distribution for X = B, is represented by the shading in the s = 
plane. The change in free energy brought about byA = ^^A = i3is determined 
by the ratio of the integrals over T of feq at X = B and X = A. 
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Figure 3: An illustration of a set of time-reversed trajectories, conjugate to tra- 
jectory segments in the time interval < s < t in (a). These trajectories are 
constructed under a time-reverse mapping as explained in Figure 1, where the 
field is also time-reversed, A(s = 0) = ^ A(s = t) = A. As these are gen- 
erated under deterministic dynamics, this bundle of reverse trajectories will be 
characterised by the same magnitude, but opposite sign of W as in (a), i.e., 
—W =F W. Notice, that the initial coordinates of these reverse coordinates are 
not significantly weighted in Zb, the partition function of the equilibrium state 
at A = -B; i.e feq(T*,X = B) is small and these reverse trajectories, sampled 
from an initial equilibrium state, are "rare". These reverse trajectories become 
less rare as the difference in A and B becomes small, and \{s) over the interval 
< s < t is reduced. This provides a practical challenge when sampling the 
distribution Pr(W = —A) in Crooks FT, or ensuring convergence in the average 
(exp [— /?Vl^]) f in Jarzynksi's equality. However, it does not negate the validity of 
either relation. One may also note that this same sampling problem can occur 
with Evans-Searles FT also. However, in Evans-Searles FT, the external agents 
must have even time parity, it is the "fast" application of external agents that 
render rare trajectories with $7^ < that can be difficult sample in experiment 
or simulation. 
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Figure 4: A typical Gaussian distribution, of unit variance o"^ = 1, for the time 
averaged flux Jt with the ensemble average {J)Fe = ~2 denoted by the dashed 
line. The other dashed line is at Jt = —{J)Fe = 2 which is the value the fluctua- 
tion theorem compares to the mean. As time proceeds, in the limit t — > oo, the 
variance decreases like ~ 1/t. 



